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(1)  ABSTRACT: 

In  close-in  air  combat  and  in  tactical  air  reconnaissance  and  surveillance 
environment,  there  are  multiple  sensors  and  multiple  targets  involved.  To  keep 
track  of  all  tactical  targets  in  such  an  environment  is  clearly  a  multi-sensor  track 
fusion  problem.  Currently,  one  of  the  widely  used  multi-sensor  fusion  trackers  is 
the  Extended  Kalman  Tracker  (EKT).  In  a  multisensor-multitarget  position 
estimation  problem,  the  key  issue  is  data  association  which  consists  of  associating 
measurements  from  a  number  of  sensors.  The  numerical  complexity  of  the  data 
association  problem  becomes  an  exponential  in  nature  as  opposed  to  a  polynomial, 
when  the  number  of  sensors  is  greater  than  3.  Furthermore,  in  a  dense  target 
environment  with  maneuvering  targets,  the  association  problem  becomes  more 
complex,  which  equates  to  more  computer  power  and  memory  resources. 

The  Gating  model,  the  position  vector  update,  and  the  covariance 
matrix  updates  are  all  required  for  matrix  inversion  for  every  sensor  measurement 
in  the  EKT.  This  matrix  inversion  uses  a  lot  of  computational  time  and  mission 
computer  memory  especially  when  operating  in  a  dense  target  environment.  The 
target  position  accuracy,  the  velocity,  and  other  target  parameter  estimations, 
may  be  affected  due  to  the  computational  time  and  compute  memory  limitations. 

This  multi-target  and  multi-sensor  track  fusion  problem  needs  to  be  addressed 
for  future  airborne  strike  and  surveillance  platforms  and  Global  Position 
System. 


A  multi-sensor  correlation  processor  with  an  a,  P,  y  tracker 
is  introduced  as  the  multi-sensor  fusion  track  model  to  address  the 
multi-target  and  maneuvering  targets.  The  new  system  requires  no 
algorithmic  matrix  inversion  and  can  be  proven  to  be  mathematically 
equivalent  to  the  popular  multi-sensor  fusion  track  model  in 
accuracy.  The  new  multi-sensor  fusion  track  model  consists  of  the 
sensors,  I/O  parameter  transformation  processor,  multi-sensor 
correlation  processor,  the  a,  P,  y  tracker,  and  the  operator  and  platform 
Interface  unit. 

We  believe  that  this  solution  is  easy  in  algorithmic  implementation, 
and  can  provide  reduced  computational  time  and  computer  memory  by 
avoiding  matrix  inversion.  The  new  multi-sensor  fusion  track  system 
should  be  considered  as  an  applied  fusion  model  to  solve  the  real 
time  multi-target  problem. 


361 


Form  SF298  Citation  Data 


Report  Date  Report  Type 

( "DD  MON  YYYY")  «.epoi  i  i  y  pe 

00001999 

Dates  Covered  (from...  to) 

("DD  MON  YYYY") 

Title  and  Subtitle 

A  Multi-Sensor  Fusion  Track  Solution  to  Address  the 

Multi-Target  Problem 

Contract  or  Grant  Number 

Program  Element  Number 

Authors 

Project  Number 

Jeun,  Buddy  H.;  Jayaraman,  Jay 

Task  Number 

Work  Unit  Number 

Performing  Organization  Name(s)  and  Address(es) 

Lockheed  Martin  Aeronautical  Systems  Marietta,  GA  30063 

Performing  Organization 

Number(s) 

Sponsoring/Monitoring  Agency  Name(s)  and  Address(es) 

Monitoring  Agency  Acronym 

Monitoring  Agency  Report 

Number(s) 

Distribution/Availability  Statement 

Approved  for  public  release,  distribution  unlimited 

Supplementary  Notes 

Abstract 

Subject  Terms 

Document  Classification 

unclassified 

Classification  of  SF298 

unclassified 

Classification  of  Abstract 

unclassified 

Limitation  of  Abstract 

unlimited 

Number  of  Pages 

13 

(2) 


INTRODUCTION: 


The  existing  extended  Kalman  track  fusion  model,  has  the  following  major  components: 

(a)  Gating  Algorithm 

(h)  Position  update  algorithm 

(c)  Covariance  matrix  update  algorithm 

It  is  computationally  intense.  Every  sensor  measurement  requires  matrix  inversion. 

It  is  too  slow  for  tracking  the  fast  target  in  a  Multi-sensor  and  multiple  target 
environment.  Therefore  the  existing  track  fusion  model  needs  improvement. 

The  objective  of  this  paper  is  to  devise  a  means  to  minimize  the  computational 
steps  and  increase  tracking  speed  for  the  fast  targets.  A  modified  Multi-sensor  track 
fusion  model  is  introduced,  to  solve  some  of  the  Multi-sensor  track  fusion  prohlems. 

The  practical  ways  to  solve  the  matrix  inversion  in  the  existing  extended  Kalman 
track  fusion  model  are: 

(a)  Replacement  of  the  gating  algorithm. 

(h)  Replacement  of  the  position  update  algorithm. 

(c)  Replacement  of  the  covariance  update  algorithm. 

With  these  replacements,  all  matrix  inversion  is  completely  eliminated. 

The  new  replaced  algorithms  will  formulate  the  new  modified  multi-sensor 
Track  fusion  model.  The  new  equations  in  the  modified  multi-sensor  track  fusion 
Are: 

(a)  The  Multi-sensor  correlation  processor,  which  is  used  to  estimate  the 
relationship  between  two  target  vectors,  performs  a  function  similar  to  the  gating 
algorithm  in  the  existing  extended  Kalman  track  fusion  model.  The  gating 
algorithm  requires  matrix  inversion  for  every  sensor  measurement,  whereas, 

the  Multi-sensor  correlation  processor  does  not  require  matrix  inversion  for 
every  sensor  measurement. 

(b)  The  a,  P,  y  Tracker  which  replaces  the  Extended  Kalman  Tracker  position 

update  algorithm  and  the  covariance  update  algorithm  Model  requires  no  matrix  inversion  for 
every  sensor  measurement,  whereas  the  Extended  Kalman  Track  fusion  model  does. 


(3)  THE  EXISTING  EXTENDED  KALMAN  TRACK  FUSION  MODEL: 
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(A)  GATING  ALGORITHM: 

G=  (Z-H*Xk)^  *  {  H*P*H^  +  R)  ■*  *  (Z  -  H*Xk ) 

(B)  POSITION  UPDATE  ALGORITHM: 

Xk,i  =Xk+  G=>=(Z-H=>=Xk) 

(C)  COVARIANCE  MATRIX  UPDATE  ALGORITHM: 

Pk+i  =  Pk  *(I-G=>=H) 


Tracking  processing: 

(a)  Sensor  measurements  are  obtained  from  the  “Sensor”  unit,  preprocessing  for  target 
feature  vectors. 

(b)  Target  feature  vector  is  passed  on  to  the  “TRK_#k”  unit  as  input  vector  for  target 
track  estimation. 

(c)  Target  tracks  are  passed  on  to  the  “Gating  Model”  unit  for  track  to  track 
correletion,  and  the  distinct  uncorrelated  target  tracks  are  sent  to  “TRK  UPDATE” 
unit  using  Extended  Kalman  Tracker  For  track  position  update  and  target 
covariance  update. 

(d)  The  updated  target  tracks  are  pass  to  PVI  unit  to  build  the  central  track 

file  (CTF),  in  which  the  Pilot  will  get  the  Multi-sensor  fused  target  tracks. 


Equations  (A) ,  (B)  and  (C)  indicate  a  matrix  inversion  calculation  for  each  sensor  measurement, 
which  will  slow  down  the  total  tracking  process  and  degrade  the  track  accuracy. 


(4)  THE  GATING  MODEL: 
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The  Gating  Model  is  one  of  the  important  elements  of  the  existing  Multi-sensor 
track  fusion  model.  The  gating  model  sometime  is  also  known  as  the  Chi  Square  Test. 
The  Gating  model  can  he  expressed  mathematically  as  follows: 

G(Z)  =  (Z  -  H  *  Xk)^  *  INV{  E  }  *  (  Z  -  H  *  Xk) 

Where  E  =  (  H  *  Pk*  +  R  ) 

Z  =  Sensor  Measurement  Vector 
Xk  =  Target  State  vector  at  time  k 
Pk  =  Target  State  Covariance  Matrix  at  time  k 
H  =  Jacohian  Matrix 
E  =  Residue  Covariance  Matrix 


Graphically,  the  Gating  model  can  he  interpreted  as  : 


Decision  Rule: 

If  Gk  (z)  =  MIN  {  Gi(z) } 

Then  z  cz  k  th  Target 

Where  z  is  the  sensor  measurement  vector  and  Gk(z)  is  the  k  th  Gating  Value. 
The  gating  value  is  very  reliable  and  provides  accurate  decision,  hut  is  computationally 
very  slow,  because  matrix  inversion  is  needed  for  every  sensor  measurement. 


(5)  THE  EXTENDED  KALMAN  TRACKER  MODEL: 

Mathematically,  the  Extended  Kalman  Tracker  model  can  be  defined  as  follows: 
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(a)  PROPAGATING  STATE  VECTOR: 

Xk  =  <!>  *  Xk.i  +  U 

(b)  PROPAGATING  STATE  COV  MATRIX: 

P^  =  <I)  *  P^.j  *  <I>T  +  Q 

(c)  KALMAN  GAIN  MATRIX: 

K  =  Pk  *  *  INV{  H  *  Pk*  +  R  } 

(d)  GATING  ALGORITHM: 

G=  (Z-H*Xk)^  *  {  H*P*H^  +  R)  *  (Z  -  H*Xk ) 

(e)  UPDATE  STATE  COV  MATRIX: 

Pk+i  =  Pk  *(I-G=>=H) 

(f)  UPDATE  STATE  VECTOR: 

Xk,i  =Xk+  G=>=(Z-H=>=Xk) 

Where  U  =  Noise  Vector 

<I>  =  Transition  Matrix 
Q  =  Noise  Cov  Matrix 
R  =  Measurement  Noise  Matrix 
Xk  =  State  Vector  at  time  k 
Pk  =  State  Cov  Matrix  at  time  k 
H  =  Jacobian  Matrix 
G  =  Gating  Matrix 
K  =  Kalman  Gain  Matrix 
Z  =  Measurement  vector 

The  Extended  Kalman  Tracker  is  one  of  the  widely  used  trackers,  Its  track  accuracy  is  very 
good,  but  equations  (c),  (d),  (e)  and  (f)  indicate  that  every  calculation  for  each  sensor 
measurement  requires  a  matrix  inversion  which  will  slow  down  the  total  tracking  process  and 
degrade  the  track  accuracy. 


(6)  THE  MODIFIED  MULTI-SENSOR  TRACK  FUSION  MODEL(U): 


(A) 


MULTI-SENSOR  CORRELATION  PROCESSOR: 

The  correlation  coefficient  between  feature  target  vectors  Xi  and  Xq 
expressed  as  follows: 


R(Xi,Xq)  =  E(j=l,n){1.0/X.j}*  ( 

Where  X.j  =  E(i=I,n)  Xy/n  ' 
Xj.  =  E(q=I,n)  Xjq/n 


2 

Xij/Xj.)-(Xqi/Xq.) 


can  be 


(B)  I,  POSITION  UPDATE  ALGORITHM: 

Xk,i  =Xk+  a*(Xk-Xk.i) 

2,  VELOCITY  UPDATE  ALGORITHM: 

Vk+i=Vk  +  T*Ak  +(p/q*T)*[Xk -Xk.i] 

3,  ACCELERATION  UPDATE  ALGORITHM: 

Ak,i  =  Ak  +  {y/(  q  *  T)"}  *  [  Xk-  Xk.i] 

Tracking  processing: 

(I)  Sensor  measurement  is  obtained  from  the”  Sensor”  unit,  preprocessing  for  target 
feature  vectors. 


(2)  Target  feature  vector  are  passed  to  the  “TRK_#k”  unit  as  input  vector  for  target 
track  estimation. 


(3)  Target  track  are  passed  to  the  “CORR  MODEL”  unit  for  track  to  track 
correletion,  and  only  the  distinct  uncorrelated  target  track  is  sent  to  “a,P,y 
UPDATE”  unit,  using  the  a,  P,  y  Tracker  for  track  position  update  and  target 

covariance  update. 

(4)  The  updated  target  tracks  are  passed  to  “  PVI”  unit  to  build  the  central  track 
file  (CTF),  in  which  the  Pilot  will  get  the  Multi-Sensor  fused  target  tracks. 


(7)  THE  MULTI-SENSOR  CORRELATION  PROCESSOR: 

The  purpose  of  Multi-Sensor  correlation  processor  is  to  measure  the  Similarity  or 
Dissemblance  of  two  target  vectors  X  and  Y.  For  similarity  measure,  the  Coefficient  of 
Correlation  is  one  if  target  X  is  the  same  as  target  Y.  For  dissemblance  measure,  the 
Coefficient  of  Correlation  is  zero  if  target  X  is  the  same  as  target  Y. 

There  are  many  forms  of  Multi-sensor  correlation  processors,  some  of  them  are  base  on 
The  similarity  measure  and  others  are  based  on  the  dissemblence  measure.  We  pick 
The  Bensecri  Correlation  Model  as  the  Multi-sensor  correlation  processor  for  the  modified 
Multi-sensor  track  fusion  model.  The  Bensecri  correlation  model  is  one  of  the  dissemblence 
Measure. 
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Mathematically,  the  Multi-sensor  correlation  processor  can  he  defined  as  follows: 


Given  Xi  =  {  Xi  i  xi  2,  Xi  y  as  feature  target  from  sensor  A 

Xq  =  {  Xq  1  Xq  2,  Xq  y  38  foature  target  from  sensor  B 


The  correlation  coefficient  between  feature  target  vectors  Xi  and  Xq  can  he  expressed  as 
follows: 


2 


R(Xi,Xq)  =  E(j=l,n){1.0/X.j}* 


(fcj/Xj.)-(Xqi/Xq.) 


Where  X.j  =  E(i=l,n)  Xy/n 
Xj.  =  E(q=l,n)  Xjq/n 


■(A) 


The  correlation  coefficient  has  value  of  zero,  if  Xi  and  Xq  are  identical,  and 

has  a  positive  number  greater  then  zero  if  they  are  different  targets.  Mathematically, 

the  property  of  the  correlation  coefficient  can  be  expressed  as  follows: 


0.0  <=  R(Xi  Xq)  <=  k 
Where  k  is  a  positive  integer. 

Equation  (A)  indicates  that  there  is  no  matrix  inversion  for  every  measurement,  if 
this  Multi-sensor  correlation  processor  is  used  in  the  modified  Multi-sensor  track 
fusion  model.  Equation  (A)  replaces  the  Gating  algorithm  in  the  existing 
Multi-sensor  track  fusion  model. 


(8)  THE  a,  p,  Y  TRACKER: 

Mathematical  model  for  the  a,  P,  y  tracker  can  be  defined  as  following: 


A  ,  Position  Update  Algorithm: 

Xk^i  =  Xk  +  a  *  (  Xk-  Xk.i) 
B,  Velocity  Update  Algorithm: 


367 


Vk,i=Vk  +  T*Ak  +(p/q=>=T)=>=[Xk -Xk.i] 

C,  Acceleration  Update  Algorithm: 

Ak^i  =  Ak  +  {y/(  q  *  T)'}  *  [  Xk-  Xk.i] 


Where  a,  P,  y  are  fixed  coefficients  filter  parameters, 
q  =  number  of  scant  =1.0 
T  =  Sample  Interval  =  1.0/F 
Xk+i  =  Target  position  at  time  (k+1) 

Vk+i  =  Target  Velocity  at  time  (k  +  1) 

Ak+i  =  Target  Acceleration  at  time  (k+1) 

K  =  1,2,3, . N 

X.i  =0. 

Xo,  Vo,  Ao  are  initial  values. 

P  =  2*(2-a)-4*  sqrt(  1-  a) 
y  =p^/(2*a) 

If  a  =  0.6,  Then  p  =  0.3,  and  y  =  0.08. 

The  a,  P,  y  tracker  is  one  of  the  widely  used  trackers,  and  it  is  a  most  algorithmic  simple  tracking 
model.  In  Paul  R.  Kalata’s  paper  ,  he  had  shown  some  of  the  tracking  parameters  are 
mathematically  equivalent  to  the  Kalman  Tracker. 
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(9)  THE  RANGE  &  ANGLE  TRANSFORMATION: 


Normally  radar  sensor  has  four  feature  elements  ;  range,  range  rate,  az  and  el 
as  an  output  vector,  and  tracker  normally  has  output  with  position,  velocity  and 
acceleration  in  x,y,z  directions.  Therefore  the  objective  of  the  range  &  angle 
transformation  is  to  simulate  the  Extended  Kalman  Tracker  with  a  set  of  equations  X, 
Y  and  Z  as  a  function  of  range  ( R ),  az  ( (p ),  and  el  (  0 ). 

Graphically,  if  we  use  NORTH,  EAST  and  DOWN  convention,  we  have: 


From  triangle  Z  ACB,  We  have: 

X  =  AC  =  R*COS((p)*  COS(0)  . (a) 

Y  =  BC  =  R*COS(<p)*  SIN(0)  . (h) 

From  triangle  ZAED,  We  have: 

Z  =AE=-  R  *  SIN(<p)  . (c) 


Equations  (a),(h)  and  (c)  are  the  required  result  of  the  range  and  angle  transformation. 


(10)  THE  X,Y,Z  TRANSFORMATION: 
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Normally  radar  sensor  has  four  feature  elements  ;  range,  range  rate,  az  and  el 
as  a  output  vector,  and  Tracker  normally  has  output  with  position,  velocity  and 
acceleration  in  x,y,z  directions.  Therefore  the  objective  of  X,Y,Z  transformation 
is  to  simulate  the  radar  sensor  and  obtained  a  set  of  equations  R,  <p  and  0  as  a 
function  of  X,Y,Z . 


Graphically,  if  we  use  North,  East,  Down  convention  and  we  have: 


From  (a),  (b)  and  (c).  We  have: 

R  =  SQRT(  X^  +  Y^  +  T})  . (d) 

From  (a)  and  (b).  We  have: 

0  =  tan\X/Y)  . (e) 

From  (c).  We  have: 

(p=-SIN'\Z/R)  . (f) 

Range_  rate  can  be  obtained  from  equation  (d)  by  differentiating  the  Range  with 

respect  to  time,  and  Range_rate  =  (X*Vx  +  Y*Vy+  Z*Vj)/R . (g) 

Equations  (d),  (e),  (f)  and  (g)  are  the  required  result  of  the  X,  Y  and  Z  transformation. 

( 11)  SIMULATIONS: 

A  simulation  using  three  targets  and  one  ownship  was  conducted  at  an  update  rate  of 
1.0  Hz  for  a  period  of  120  seconds  for  the  existing  Multi-sensor  track  fusion  model. 
The  tracking  errors  were  below  4.0%  for  all  cases,  but  120  seconds  is  considered  too 
slow  for  fast  moving  targets.  Currently,  we  are  working  with  the  modified  Multi- 
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sensor  track  fusion  model,  and  expect  the  time  to  be  faster,  because  the  modified 
Multi-sensor  track  model  requires  no  matrix  inversion  for  every  sensor  measurement. 

(a)  TARGET  MODELS: 

Tl:  Xl(t)  =  a*  tH  b*  t  +  c 

where  a  =  0.01,  b  =  0.02,  c  =  3.0 

T2:  X2(t)  =  a*  t  +  b 

Where  a  =  1.5,  b  =1.0 

T3:  X3(t)  =  a*(1.0-e''’*‘)+  c 

Where  a  =  300.0,  b  =  0.0005,  c  =  1.0 

Ownship:  X0(t)  =  a  *  t  +  b 

Where  a  =  0.5,  b  =  30.0 

(b)  TRACKING  ERRORS: 


(12)  CONCLUSIONS: 

(a)  Theoretically,  the  Modified  Multi-Sensor  Track  Fusion  Model  is  the  most 
algorithmically  simple  compared  to  the  existing  Multi-Sensor  Track  Fusion 
model.  The  a,  P,  y  tracker  in  the  modified  Model  is  much  easy  to  implement 
compared  to  the  Extended  Kalman  Tracker  in  the  existing  Model.  The 
Multi-Sensor  Correlation  Processor  in  the  modified  Model  is  mathematically 
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Simple  compared  to  the  Gating  Model  in  the  existing  Model 

(h)  Matrix  inversion  is  required  for  every  sensor  measurement  in  the  Gating  Model, 

position  state  vector  update  algorithm,  and  covariance  matrix  update  algorithm  of  the  existing 
Multi-sensor  track  fusion  model.  Every  matrix  inversion  takes  a  lot  of  time,  and  computer 
memory  resource.  This  alone  will  slow  down  the  total  tracking  time  and  track  accuracy. 

(c)  There  are  no  matrix  inversions  for  every  sensor  measurement  in  the  Multi-Sensor 

correlation  processor,  and  in  the  a,  P,  y  Tracker  of  the  Modified  Multi-Sensor  Track  Fusion 
Model.  This  is  a  mathematically  an  advantage  over  the  existing  Multi-Sensor  Track  Fusion 
Model. 


(d)  The  performance  and  track  accuracy  of  the  Tracker,  depends  on  the  target  noise,  filter 

parameters,  and  constant  coefficients.  Dr.  Paul  R.  Kalata  has  published  a  paper  in  the  IEEE, 
which  shows  that  the  a,  P,  y  Tracker  yields  similar  and  consistent  results  when  compared  with 
the  Kalman  Tracker. 
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